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SINGULARLY PERTURBED CONTROL SYSTEMS WITH 
NONCOMPACT FAST VARIABLE 

THUONG NGUYEN AND ANTONIO SICONOLFI 


Abstract. We deal with a singularly perturbed optimal control problem with slow and 
fast variable depending on a parameter e. We study the asymptotic, as e goes to 0, of the 
corresponding value functions, and show convergence, in the sense of weak semilimits, to 
sub and supersolution of a suitable limit equation containing the effective Hamiltonian. 

The novelty of our contribution is that no compactness condition are assumed on the 
fast variable. This generalization requires, in order to perform the asymptotic proce¬ 
dure, an accurate qualitative analysis of some auxiliary equations posed on the space of 
fast variable. The task is accomplished using some tools of Weak KAM theory, and in 
particular the notion of Aubry set. 


1. Introduction 

We study a singularly perturbed optimal control problem with a slow variable, say 

x, and a fast one, denoted by y, with dynamics depending on a parameter e devoted 
to become infinitesimal. We are interested in the asymptotic, as e goes to 0, of the 
corresponding value functions V £ , depending on slow, fast variable and time, in view of 
proving convergence, in the sense of weak semilimits, to some functions independent of 

y, related to a limit control problem where y does not appear any more, at least as state 
variable. 

More precisely, we exploit that the V £ are solutions, in the viscosity sense, to a time- 
dependent Hamilton-Jacobi-Bellman equation of the form 

u £ t + H ^x, y, D x u £ , = 0 

and show that the upper/lower weak semilimit is sub/supersolution to a limit equation 

ut + H(x, Du) = 0 

containing the so-called effective Hamiltonian H, obtained via a canonical procedure we 
describe below from the Hamiltonian of the approximating equations. We also show that 
initial conditions, i.e. terminal costs, are transferred, with suitable adaptations, to the 
limit. See Theorems 14.3114.41 which are the main results of the paper. 

We tackle the subject through a PDE approach first proposed in this context by Alvarez- 

Bardi, see and the survey booklet [3], in turn inspired by techniques developed in 

l 
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the framework of homogenization of Hamilton-Jacobi equations by Lions-Papanicolau- 
Varadhan and Evans, see The singular perturbation can be actually viewed 

as a relative homogenization of slow with respect fast variable. In the original formulation, 
homogenization was obtained assuming periodicity in the underlying space plus coercivity 
of the Hamiltonian in the momentum variable. 

Alvarez-Bardi keep periodicity in y, but do without coercivity, and assume instead 
bounded time controllability in the fast variable. A condition of this kind is indeed un¬ 
avoidable, otherwise it cannot be expected to get rid of y at the limit, or even to get any 
limit. Another noncoercive homogenization problem, arising from turbulent combustion 
models, has been recently investigated with similar techniques in jlHj . 

The novelty of our contribution is that we remove any compactness condition on the fast 
variable, and this requires major adaptations in perturbed test function method, which is 
the core of the asymptotic procedure. We further comment on it later on. 

Following a more classical control-theoretic approach, namely directly working on the 
trajectory of the dynamics, Arstein-Gaitsgory, see [7] and m, m, have studied a similar 
model replacing in a sense periodicity by a coercivity condition in the cost, and allowing 
y to vary in the whole of M m , for some dimension M. Beside proving convergence, they 
also provide a thorough description of the limit control problem, in terms of occupational 
measures, see [EJ. This is clearly a relevant aspect of the topic, but we do not treat it here. 

Our aim is to recover their results adapting Alvarez-Bardi techniques. We assume, as in 
[7] and [5], coercivity of running cost, see (H4), and a controllability condition, see (H3), 
stronger than the one used in in, m, 0 and implying, see Lemma 12.91 coercivity of the 
corresponding Hamiltonian, at least in the fast variable. We do believe that our methods 
can also work under bounded time controllability, and so without any coercivity on H , but 
this requires more work, and the details have still to be fully checked and written down. 

The focus of our analysis is on the associate cell problem, namely the one-parameter 
family of stationary equations, posed in the space of fast variable, obtained by freezing in 
H slow variable and momentum, say at a value (xo,R>)- Its role, at least in the periodic 
case, is twofold: it provides a definition of the effective Hamiltonian H at (xo,po) as the 
minimum value of the parameter for which there is a subsolution (then also supersolutions 
or solutions do exist), the corresponding equation will be called critical in what follows, 
and critical sub/supersolutions play the crucial role of correctors in the perturbed test 
function method. 

The absence of compactness calls into questions the very status of the critical value 
H(xo,po) since, in contrast to what happens when periodicity is assumed, the existence of 
solutions does not characterize any more the critical equation, see Appendix [A] Moreover 
critical sub/supersolutions must enjoy suitable additional properties, as explained below, 
to be effective in the asymptotic procedure. 


SINGULARLY PERTURBED CONTROL SYSTEMS WITH NONCOMPACT FAST VARIABLE 


3 


The two issues are intertwined. By performing a rather accurate qualitative analysis of 
the cell problems, we show that (sub/super) solutions usable as correctors can be obtained 
only for the critical equation. We make essentially use for that of tools issued from weak 
KAM theory, and in particular of the capital notion of Aubry set. As far as we know, it is 
the first time that this methodology finds a specific application in singular perturbation 
or homogenization problems. 

The geometric counterpart of coercivity in the cost functional is that the critical equa¬ 
tion has a nonempty compact Aubry set for every fixed (xo,Po)> see Lemma 13.81 which in 
turn implies existence of coercive solutions possessing a simple representation formula in 
terms of a related intrinsic metric, and bounded subsolutions as well, see Propositions 13.71 
13.91 Coercive solutions, up to modification depending on e (see Subsection 13.31) . are used 
in the upper semilimit part of the asymptotic, which is the most demanding point of the 
analysis. 

The paper is organized as follows. In Section 2 we give some preliminary material 
and standing assumptions, we then study some relevant property of controlled dynamics 
and how they affect value functions. Approximating Hamilton-Jacobi-Bellman equations 
and limit problem are also defined. Section 3 is about cell problems and construction of 
distinguished critical sub/supersolutions to be used as correctors. Sections 4 contain the 
main results. The appendix is devoted to review some basic facts of metric approach and 
Weak KAM theory for general Hamilton-Jacobi equations. 


2. Setting of the problem 

2.1. Notations and terminology. Given an Euclidean space, say to fix ideas W N , for 
some N G N, x G and R > 0 we denote by B(x,R ) the open ball centered at x with 
radius R. Given B C M N , we indicate by B, intB, its closure and interior, respectively. 
Given subsets B , C , and a scalar A, we set 

B T C — {x T y | x G B : y G G{ 

A B = {Ax | x G B}. 

We make precise that in all Hamilton-Jacobi equations we will consider throughout the 
paper the term (sub/super) solution must be understood in the viscosity sense. 

Given an upper semicontinuous (resp. lower semicontinuous) u : M N —> R, we say that 
a function '0 is supertangent (resp. subtangent) to a u at some point xo if it is of class 
C 1 , u = v at xo and 

i/> > u (resp. ifi < u), locally at xq. 

If strict inequalities hold in the above formula then will be called strict supertangent 
(resp. subtangent). 
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Given a sequence of locally equibounded functions u n : R A/ —>• R, the upper weak 
semilimit (resp lower weak semilimit) is defined via the formula 

(limsup^tt n )(x) = sup{limsupu n (x n ) | x n —> x} 

n 

(resp. (liminf^tw n )(x) = infjliminf u n (x n ) \ x n —> ®}). 

n 

If u is a locally bounded function and we take in the above formula the sequence u n 
constantly equal to u then we get through upper (resp. lower) weak semilimit the upper 
(resp. lower) semicontinuous envelope of u, denoted by u # (resp. u#). It is minimal (resp. 
maximal) upper (resp. lower) semicontinuous function greater (resp. less) than or equal 
to u. 

2.2. Assumptions. We assume that the slow variable, usually denoted by x, lives in 
M. n and the fast variable y in R M , for given positive integers N , M. We denote by A 
the control set, by / : R^ x R M x A —> R N , g : R^ x R M xi-> R A/ the controlled 
vector fields related to slow and fast dynamics, respectively. We also have a running cost 
t : R^ x R m x A —y R and a terminal cost uq : M N x R A/ —> R. We call, as usual, control 

a measurable trajectory defined in [0, +oo) taking values in A. We require: 

(HI) Control set : A is a compact subset of some Euclidean space; 

(H2) Controlled dynamics: There is a constant Lq > 0 with 

\f(xi,yi,a) - f(x 2 ,y 2 ,a)\ < L 0 (|aq - x 2 \ + \yi - 3/2I) 

\g(xi,yi,a) - g(x 2 ,y 2 ,a)\ < L 0 (|xi - x 2 \ + \yi - 3/2I) 

for any ( Xi,yi ), i = 1,2 in R^ x R A/ and a G A; we assume in addition that |/| is 
bounded with upper bound denoted by Q 0 ; 

(H3) Total controllability: For any compact set K C M' v x1 m there exists r = r(K ) > 0 
such that 

B( 0, r) C c og(x, y, A) for (x, y) € K, 

where g(x, y. A) = {g(x, y, a) \ a G A}; 

(H4) Running cost: £ is continuous in R^ x R A/ x A, and for any compact set B C R^ 

(1) lim min l{x, y, a) = + 00 ; 

|2/|^+oo (x,a)£BxA 

(H5) Terminal cost : uq is continuous and bounded from below in R n xR m . To simplify 
notations, —Qo, see (H2), is also taken as lower bound of uq in R^ x R M . 

Taking into account Assumption (H5), we define 

uq(x) = inf uo(x,y) for any x G R^. 

y eR M 


(2) 
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This function is apparently upper semicontinuous, and will play the role of initial con¬ 
dition in the limit equation we get in the asymptotic procedure. 

Remark 2.1. Due to Relaxation Theorem plus Filippov Implicit Function Lemma, see 
for instance @ 1 , HD!, the integral trajectories of the differential inclusion 

C € c og(x, C, A) for x fixed in M , 
are locally uniformly approximated in time by solutions to 
(3) ?) = g(x, Tj, a) for some control a. 

By iteratively applying this property to a concatenation of a sequence of curves of © for 
infinitesimal times, we derive local bounded time controllability for fast dynamics, namely, 
given Ri, R 2 positive, there is To = Tq(R \, R^) such that for any 7 / 1 , 7/2 in £>( 0 , £ 4 ), 
x € £>(0, R 2 ), we can find a trajectory 77 of Q joining y\ to 7/2 in a time T <Tq. 


2.3. Controlled dynamics. For any e > 0, any control a, the controlled dynamics is 
defined as 


0 CD e 


i(t) = £ f{€(t),r](t),a(t)) 
v(t)= £r(€(t),r?(t),a(t)) 


Notice that if 77 are solutions to flC£b D with initial data (x, y) then the trajectories 

1 1 -)- rj(t/e) 

are solutions to 

£o(i) = f(£o(t),r]o(t),ai(t/£)) 

cyo (t) = g(^o{t),y 0 (t),a(t/£)) 


(' cd £ 


with the same initial data. 

Given a trajectory £, 77 of \CP £ \) with initial data (x, y) and control a, for some e > 0, 
and T > 0, we deduce from standing assumptions and Gronwall Lemma, the following 
basic estimates: 


(4) 

If £ satisfies 
then 


\£(t) - x\ < QoT for t G [0, T/e\. 
C = g(x,(,a) C(0 ) = y, 


< 


/ \g{£,y,u) -g(xX,a)\ds 

Jo 


< L o (1C -x\ + 1 77 - Cl) ds < L 0 £Q 0 T 2 e L ° T . 


(5) 


\y(T)~C(T)\ 
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Finally 


( 6 ) 


\v(T)~y\ < / \d(C,V,a) - g(f,y,a)\ds + [ |g(£, y, a)| ds 

Jo Jo 


< L 0 R T e L ° T , 

where R is an upper bound of \g\ in B(x,eT ) x {y} x A, and similarly 

( 7 ) \f](T)-y\ < [ \g(£,ri,a) - g{£,ri(T),a)\ds + [ \g(£,rj(T),a)\ds 

Jo Jo 

< Lo R' T e L ° T , 

where R' is an upper bound of \g\ in B(x,eT ) x {g(T)} x A. 

By using bounded time controllability condition, we further get: 

Lemma 2.2. Given R\, Ro positive , x € B(0,Ri), y, z in B(0, R 2 ), there is, for any e, 
a trajectory (£ e ,r] e ) of ( |( 7-h-p , starting at (x,y) and a time T e with 

(8) Tq(Ri, Rf) < T e < 3To(i?i, R 2 ) 
such that 

I Ve(T e ) ~z\ = 0(e). 

The quantity Tq(-, ■) is as in Remark {K7\ 

Proof: By controllability condition, see Remark 12. 11 there is a control a and a trajectory 
£ with 

(9) ( = g(x, C 5 of) for a suitable a 

starting at y and reaching z in a time T e < Tq(/?i , Ra). Up to adding a cycle based on 
z and satisfying (0 for some control, we can assume T e to satisfy <[8|). Note that such a 
cycle does exist again in force of the controllability condition. We then take, for any e, 
the trajectories (£ e ,%) of QG Y ZU[ ) starting at (x,y) corresponding to the same control a, 
and invoke ® to get the assertion. □ 


We derive: 

Proposition 2.3. Given a bounded set B ofR N x and S > 0, there exists a bounded 
subset Bq D B such that for any initial data in B and any e, we can find a trajectory of 
flCTb[ ) lying in B$ as t € [0, S'/e]. 

Proof: We fix (x, y) 6 B. By ((JJ), we can find Ri, R 2 such that B C B(0,Ri) x B(0, R 2 ), 
and the first component £ of any trajectory (£, ??) of ( |C7U[ ). for any e, starting at (x,y) is 
contained in B(0,R\). We write To for Tq(Ri, R 2 ). Clearly, it is enough to establish the 
assertion for e small. 
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By applying Lemma 12.21 with e suitably small and z = 0, we find a time T e and a 
trajectory (£ e ,r) e ) of ( |C7Lp such that (£ e (T e ), r] e (T e )) G 5(0, Ri) x 5(0, R 2 )- Taking into 
account that the time T e is estimated from above and below by a positive quantity, see 
(J 8 |), we can iterate the procedure and get by concatenation of the curves so obtained, a 
trajectory (£o, 7 o) in [ 0 , to/e], starting at (x,y), with the crucial property that there are 
times {L}, i = 1, ■ ■ ■ k, for some index k, in [0, 5/e] such that 


for any t G [0, 5/e], there is L with 1 1 — tj| < 3To; 
Ve(ti) G B(0,R 2 ) for any i. 

We derive as t G [0, j ] 


(10) — icol < QoS' 

(11) \Ve(t)\ < R 2 + 3PT 0 


with constant P solely depending, see ([ 6 |), upon R\, R 2 , Tq{R\,R 2 ). This proves the 
assertion. 

□ 


The next result is a strengthened version of Lemma 12.21 stating that the approximation 
of a value of the fast variable by a trajectory of the fast dynamics can be realized in any 
predetermined suitably large time. To establish it, we need exploiting total controllability 
assumption (H3) in its full extent. The lemma will be used in the proof of Theorem 14.41 


Lemma 2.4. Given x € M , y, z in M , and 5 > 0 suitably large, there is, for any e, a 
trajectory (£ e ,rj e ) of ( |67T[ ). starting at (x,y) such that 

l7e(S) — z\ = O(e). 


Proof: We fix i?i, R 2 such that x G £>(0, Ri), and y, z are in B(0,R 2 ). We take 5 with 
5 > 3 To(i?i, R 2 ). By applying Lemma [2721 we find T e < 3To(i?i, R 2 ) < S and, for any e, 
a curve (^ e , 7 / e ) of ( |CLL| ) starting at (x,y) with 

I Ve{T £ ) -z\ = O(e). 

By iterating the procedure, if necessary, as in the proof of Lemma 12.21 we can extend it 
to an interval [0, 5 e ], with 5 — S £ < T e , still getting 

(12) \Ve(S £ ) -z\ = O(e). 

By (H3) and Relaxation Theorem, see Remark EU we find a control /3 and a trajectory 
Ce satisfying 

Ce=9(fe(S e ), Ce,P) Ce(0) = T) e (S £ ) 


with 

(13) 


\Ce(t) ~ile(S £ )\ = O(e) 


for t G [0, 5 — S £ ]. 
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Owing to ©, the trajectory ($ £ ,r] £ ) of flCLLD starting at (^ £ (S £ ),rj E (S £ )), with control /3 
satisfies 


(14) 


\r, 0 e (S-S £ )-( £ (S-S £ )\ = O(e). 


By concatenation of rj e and 77 °, we finally get, in force of (fT 2 l) . (fl3l) . f[T4l) . a trajectory 
satisfying the assertion. □ 


2.4. Minimization problems and value functions. We consider for any ( x , y) € M. N x 

M m , t > 0 , e > 0 , the optimization problems 


(15) 


inf e 




,Ve 


with £ e , r) £ are solutions to flC D , | ) in [0,+ 00 ), issued from the initial datum (x,y). Or 
equivalently with the change of variables r = e s 


(16) 


inf / £(g,ri°,a) dr + «o(f°(i),»7°(i))) 


with r] £ are solutions to ( CP £ ) in [0,+ 00 ), issued from (x,y). We denote by V £ the 
corresponding value functions, namely the functions associating to any initial datum (x, y ) 
and time t the infimum of the functional in (1151) / (1161) . They are apparently continuous 
with respect to all arguments. 


Remark 2.5. Looking at the form of the above minimization problem, we understand 
that coercivity assumption (H4) plus (H5) plays the role of a compactness condition for 
the fast variable, inasmuch as it implies that the trajectories of the fast dynamics realizing 
the value function, up to some small constant, lie in a compact subset of . This fact 
will be crucial in the asymptotic analysis. 


We derive from Proposition 12.31 

Proposition 2.6. The value functions V s are locally equibounded. 

Proof: Let C be a bounded set of x R M x [0,+ 00 ), and (xo, 2 /(Mo) £ C. Thanks to 
Proposition 12.31 there are for any e trajectories (£o,t]q), we drop the dependence on e to 
ease notations, of \CP £ D starting at (xo, yo), and contained in a bounded set of l w x R M 
solely depending on C. By using the formulation (1151) of the minimization problem, we 
get 

fif 

V e (x 0 ,yo,t 0 ) <£ / t{£ 0 {s),r]o(s),a{s))ds + u 0 (£o(t 0 /e),r)o(to/£)). 

Jo 
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Since the integrand in the above formula and uq are bounded independently of e, we obtain 
the equiboundedness from above of the V £ . 


We now consider any trajectory (£, 77 ) of ( ]C7T-[ ) starting (xo,yo) and corresponding to 
a control (3. By dH), £(t) lies in a compact subset K of R N , only depending on C, for 
t € [0, to/s ]5 and by coercivity assumption (H4), there is a constant Pq with 


(17) 


£(x, y , a) > Pq for any (x, y, a) € K x M m x A. 


Since —Qo is a lower bound of uo in x W M , see (H5), this implies 


P-S. 

(18) e e(£(s),ij(s),l3{s))ds + uo(£(t 0 /£),ri(to/£)) > 

Jo 

£ T Po + u o(C(to/£),y{t 0 /£)) >P 0 t 0 - Q 0 . 

Being (£, 77 ) an arbitrary trajectory with initial point (xo,yo), the above inequality shows 
the claimed local equiboundedness from below of value functions. 

□ 


The previous result allows us to define limsup^W, liminf^W, these functions will be 
denoted by V, V, respectively, in what follows. The next proposition shows that they only 
depend on time and slow variable, at least for positive times. 

Proposition 2.7. We have 

(liminf # W)(xo,7/o,to) = i}immi # V £ )(x 0 , z 0 ,t 0 ) =: V(x 0 ,t 0 ) 
(limsup # P £ )(x 0 ,yo,to) = (limsup # l/ e )(x 0 ,z 0 ,to) =: V(x 0 ,t 0 ) 

for any xo € , yo, zq in R AI and > 0. 

Proof: We start by 

Claim: Given positive constants R\, R 2 , S we can determine P = P(Ri, R 2 , S) > 0 such 
that for any e > 0, x € B(0,Ri), y, z in £>(0, R 2 ), t £ [0,5] there exist x', x", z' , z" , t' , 
t", depending on e, with 

|X — x'\ < £ P, \z — z'\<sP, \t — t'\<£P, 

\x — x"\ < £ P, \z — z" | < £ P, |f — t" | < £ P 


such that 


V £ (x',z , ,t') < V e (x,y,t)+£P 

V £ (x",z",t") > V £ (x,i/,t)-£P. 
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We fix e. By controllability assumption (see Remark EH z and y can be joined in a 
time T less than or equal to To = To (Pi, R 2 ) by a curve £ satisfying 

£ = g(x, £, cx) for a suitable control a. 

We consider the trajectory (£, 77 ) of fl CD e ) with the same control a satisfying 

£(T) = x and rj(T) = y, 

and set 

x' = £( 0 ) and z' = 77 ( 0 ). 

By (@D, ©, we get 

(19) \x — x\ < e Po 

(20) \z' — z\ < £ Po 


for a suitable Po > 0. We select a trajectory (£o,??o) of ( | 6 '/P-p with initial datum (x,y), 
corresponding to a control (3, such that 


(21) V e (x,y,t)>£ J e(£ 0 ,r]o,P)ds + u 0 ( 


,V 0 


— £. 


We set 

(22) t' = t + £T, 

by concatenation of a and j3, £ and £ 0 , rj and 7 / 0 , we get a control 7 and trajectory (£, 77 ) 


of jC7P-[ ) starting at (x',z'), defined i 


m 


’ £ 


. We consequently have 


V E {x',z' ,t') < 

t' 

s J 0 ‘ e ( M.7)d 8 + «o(f(l),5(l)) = 

rT P3 

£ J £(£,77,a)ds + e J ^(£o(s — T),r] 0 (s — T),(3(s — T)) ds + 

By taking into account © and m, we derive 

(23) V e {x' , z\ t') < £ Q Tq + R £ (x, y, t) + e for a suitable Q > 0. 

The first part of the claim is therefore proved taking into account (fl9l) . (f20l) . (l22l) . (l23l) . 
and defining 

P = max{P {) . Tq, Q T 0 + 1}. 

The estimates for x", y ", z", t" can be obtained slightly modifying the above argument. 
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We sketch the proof for reader’s convenience. We denote by f a curve joining y to z in a 
time T' < Tq and satisfying 


C 7 = g(x, a) for a suitable control a'. 

We consider the trajectory (£', if) of flC7h-| ) with the same control a’ satisfying 

£'(0) = x and rf{ 0) = y, 

and set 

x" = i\T') and z" = y'(T'). 

As in the first part of the proof we get 

\x" — x\ < Pq£ 

\z" — z\ < Pq£, 

for a suitable Po- We select a trajectory (f'oiV'o) °f Q£4P g [ ) with initial datum ( x",z"), 
corresponding to a control /3 r , which is optimal for V £ (x", z" , t — eT') up to e, namely 


t" 

v £ (x", z", t") > £ J 0 , Vo, P') + u o ^0 


t"\ , ft 

,Vo 


— £. 


Here we are assuming e so small that t '' := t — eT' is positive, this does not entail any 
limitation to the argument since we are interested to e infinitesimal. From this point we 
go on as in the previous part. 

We exploit the first part of the claim to show that for any pair of values yo, zq of the 
fast variable, any xo £ R N , t o > 0 

(24) (lim inf #V e )(xq, zo,to) < (lim inf # H e )(x 0 , yo, to), 


which in turn implies by the arbitrariness of yo, z o, that limindependent of the 
fast variable. We consider e n , x n , y n , t n converging to 0, xq, yo, to, respectively, with 

lim V £n (x n ,y n ,t n ) = (liminf # H £ )(x 0 , z 0 , t 0 ). 

n 


Since all the x n , y n , and zq, t n are contained in compact subsets of R N , R A/ , [0, H-oo), 
respectively, we can apply, for any given n £ N, the claim to e = £ n , x = x n , y = y n , 
z = zo, t = t n and get of x' n , z' n , t' n with 

| X n X n \ < £ n P, |^o z n\ 7 £ n P, \tn t n \ 7 £ n P 

and 

V n ( x n, z n, t n ) < H n (x n , y n , t n ) + £ n P 
for a suitable P. Sending n to infinity we deduce 

lim inf V £n (x' n , z' n ,t' n ) < lim V £n {x n ,y n ,t n ) = (liminf # F E )(x 0 ,zo,to), 
which implies (1241) since x' n -£ xq, z' n -£ zq and t/ n -£ to- 
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The assertion relative to limsup^V^ is obtained using the second part of the claim and 
slightly adapting the above argument. 


□ 


As a consequence of coercivity of running cost assumed in (H4) we deduce: 

Proposition 2.8. The value function V £ satisfy for any e, any compact subset K of 
R n x (0, Too) 

lim min V £ (x, y, t) = Too. 

\y \—>+oo (x,t)^K 


Proof: We fix e, we assume, without loosing any generality, that K is of the form K x 
[S, T ], where K is a compact subset of M. N and S, T are positive times. Given any P > 0, 
we can determine by (H4) a constant R such that the ball B(0,R) of R Af satisfies 


(25) £(x, y, a) > P for any ( x , a) G K x A, y G R A/ \ B( 0, R). 

Taking into account the estimate (JTj), we see that there exists Ro > R such that 

(26) rj(t) 0 B(0, R) for t G [0,T] 

for any trajectory of flC7T-D starting in Kq x (R m \ B(0, R 0 )) . Given 6 > 0, we find, for 
any 

(x,y,t) G Kq x (R m \ B(0,Ro)) x [5,T] 

a trajectory (£o,7o) of dCD £ D , corresponding to a control a , starting at (x,y) with 

V £ (x,y,t)>e J £(fo,Vo,a)ds + u 0 (^ 0 (^j ~5. 

We deduce by (1251) . (1261) . (H5) 

V £ (x,y,t) > P S - Q 0 - 5, 

which gives the assertion, since P can be chosen as large as desired, and 6 as small as 
desired. □ 


2.5. HJB equations. We define the Hamiltonian 

H{x,y,p,q) = max{— p ■ f(x,y,a ) - q-g(x,y,a ) -£(x,y,a)} 
aeA 

The main contribution of Assumption (H3) is the following coercivity property on H: 

Lemma 2.9. For any given bounded set C C R^ x R x R^, we have 

lim min H(x, y,p, q) = Too. 

|g|->+oo ( x,y,p)£C 
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Proof: We denote by r the positive constant provided by (H3) in correspondence to the 
projection of C on the state variables space R^ x R A/ . We consequently have for (x,y) in 
such projection and q £ M. RI 

(27) max{g • v \ v £ g(x, y, A)} = max{(/ -v\v£ co g(x, y, A)} > r \q\. 

We take (x,y,p) £ C, and denote by ao an element in the control set such that g(x,y,ao) 
realizes the maximum in (1271) . We get from the very definition of H and (1271) 

H(x,y,p,q ) > -\p\ \f{x,y,a 0 )\ +r\q\ - \£(x,y,a)\ for any q. 

When we send |g| to infinity, all the terms in the right hand-side of the above formula 
stay bounded except r |</|. This gives the assertion. 

□ 


Given a bounded set B in M. N x R M , one can check by direct calculation that H satisfies 

(28) I H(xi,y 1: p,q) - H(x 2 ,y 2 ,p,q)\ < 

L 0 (|xi - x 2 \ + \yi - V 2 \)(\p\ + |<?|) +w(|xi - x 2 \ + |yi - y 2 1) 

for any (x\,yi), (x 2 ,y 2 ) in B and (p,q) £ x , where u is an uniform continuity 
modulus of £ in B x A and L$ is as in (H2). We also have 

(29) \H(x, y,pi, qi) - H(x,y,p 2 ,q 2 )\ < 

\f{x,y,a 0 )\\pi -p 2 1 + \g(x,y,a 0 )\\q 1 - q 2 \ 

for any (x,y) £ R w x R M , (pi,qi), ( P 2 ,Q 2 ) in R W x R M , a suitable ao £ A. 

We write, for any e > 0, the family of Hamilton-Jacobi-Bellman problems 

| u e t + H (x,y,D x u £ , = 0 

[ u £ (x,y, 0) = u 0 {x,y ) 


It is well known that the value functions V £ are solutions to QHJ £ D , even if not necessarily 
unique in our setting. However, due to the estimate (|28j) . we have the following local 
comparison result (see for instance mr- 


Proposition 2.10. Given a bounded open set B of R w x R A/ and times t 2 > t\, let u, v be 
continuous subsolution and supersolution, respectively, of the equation in QHJ £ D . If u < v 
in d p (B x (£ 1 ,^ 2 )) then u < v in B x {t\,t 2 ), where d p stands for the parabolic boundary. 


We define the effective Hamiltonian 

(30) H(x,p) = inf {b £ R | H(x, y,p , Du) = b admits a subsolution in R A/ } 

for any fixed (x,p) £ R^ x M. N , where the equation appearing in the formula is solely 
in the fast variable y with slow variable x and corresponding momentum p frozen. This 
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quantity can be in principle infinite, however we will show in what follows that not only 
it is finite for any (x,p), but also that the infimum is actually a minimum. 

We write the limit equation 
(HJ) ut + H(x, Du) = 0. 


3. Cell problems 

The section is devoted to the analysis of the stationary Hamilton-Jacobi equations in 
R m appearing in the definition of effective Hamiltonian, namely with slow variable and 
corresponding momentum frozen. 

3.1. Basic analysis. We fix (xq,pq) € M. N x M. N , and set to ease notations 

Ho(y, q ) = H(x o, y,po, q) for any (y , q) € M m x R m 

4(y,a) = £(x 0 ,y,a) + p 0 ■ f(x 0 ,y,a) for any (y,a) € M m x A 

9o(y,a) = g(x 0 ,y,a) for any (y, a) <E R M x A 

Given a control a(t), we consider the controlled differential equation in R M 
(31) f){t) = g 0 (v(t),a(t)). 

We directly derive from Lemma 12.91 
Lemma 3.1. We have 

lim min H^y. q) = +oo 
|<?|—l+oo y&K 

for any compact subset K of R AI . 

This result implies, according to Lemma fA.il that all subsolutions are locally Lipschitz- 
continuous, and allows adopting the metric method, see Appendix [Af in the analysis of 
the cell equations. To ease notation, we set cq = H(xo,po), also called the critical value 
of Ho, see ([86]) . We will prove in Proposition 13.31 that Co is finite. We denote by Z, a, S 
the corresponding sublevels, support function and intrinsic distance, see Appendix [A] for 
the corresponding definitions. Same objects for a supercritical value b will be denoted by 

^bi '^b ■ 

To compare the metric and control-theoretic viewpoint, we notice 

Zb{y) = {q€R M \q - (~go(y, a)) < £ 0 (y, a) + b for any a € A}. 
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for any given supercritical b € K, namely b > Co, and y € R M . This implies that the 
support function a b (y, •) is the maximal subadditive positively homogeneous function p : 
R M —)• R with 

(32) p{-go(y, a)) < £ 0 (y, a) + b for any a € A, 

which somehow justifies the next equivalences. 

Proposition 3.2. Given a supercritical value b, the following conditions are equivalent: 

(i) u is a subsolution to Ho = b; 

(ii) u(y 2 ) - u(yi) < S b (y 1 ,y 2 ) for any y u y 2 ; 

(iii) u(yi) — u(y 2 ) < f^(£o(y(t), a(t)) + b)dt for any y\, y 2 , time T, control a, any 
trajectory y of (EU) with 7/(0) = Vi, t/(T) = y 2 . 

Proof: The equivalence (i) -s=>- (ii) is given in Proposition IA.3I (i), the equivalence 
(i) •<=>■ (iii) is the usual characterization of subsolutions to Hamilton-Jacobi-Bellman 
equations in terms of suboptimality, see □ 

One advantage of metric method is that any curve is endowed of a length, while integral 
cost functional is only defined on trajectories of the controlled dynamics. Also notice that 
there is a change of orientation between length and cost functional, that can detected 
from (132 p and comparison between items (ii) and (iii) in Proposition 13.21 This just 
depends on uq being terminal cost and initial condition in ( |HJ e [ ), the discrepancy should 
be eliminated if ( |HJ g [) were posed in (—oo,0) and uq should consequently play the role of 
terminal condition and initial cost. 

Proposition 3.3. The critical value cq is finite. 

Proof: Owing to coercivity of t and boundedness of / 

Hv(y,0) = max{—fo(y,a)} —> —oo as \y\ —> +oo 

agA 

and consequently 

Hq(ij, 0) < 0 outside some compact subset K of R^ 1 . 

We set 

bo = max {0, max{i^o(aJ, 0) | x € }}, 

then the null function is subsolution to Ho = bo in R M , and so Co < +oo. 

By controllability condition (H3), we find a cycle y defined in [0, T], for a positive T, 
solution to (1311) for some control a. We put 

R = [ £ 0 (ri,a)dt, 

Jo 
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and for b < — & we get 


f 


{£o(v, a) + b) dt < R - ^ T = 0. 


The above cycle, repeated infinite times, gives a trajectory of (13TT) in [0, +oo), still denoted 
by r i, such that 


(33) 


poo 

/ (£o(rj,a) + b) dt 

Jo 


= —oo. 


If there were a subsolution u to Hq = b then 

(34) u(rj( 0)) - u(r](t 0 )) < [ (£ 0 (r](t),a(t)) + b ) dt for any t 0 > 0. 

Jo 

But the support of 7/ is equal to ??([0,T]) which is a compact subset of M m , so that the 
oscillation of u (which is locally Lipschitz continuous) on it is bounded. This shows that 
(1331) and (IM1) are in contradiction. We then deduce that the equation Hq = b cannot have 
any subsolution, showing in the end that cq > —oo. □ 


We deduce from standing assumptions a sign and a coercivity condition on the critical 
distances. To do that, we start selecting a compact set C of with 

(35) H 0 (y, 0) = - min4(y, a) < c 0 - Q 0 for any y € M M \ C, 

aeA 

where Q o is as in (H2). This is possible since £q is coercive. Further we set 


(36) 


Ko = 12/1 d(y, C) < max \S\ } . 

0X0 


Proposition 3.4. The following properties hold true: 

(i) lim|j / |_ >+00 inf. yoG x S(yo, y) = +oo for any compact set K C M m ; 

(ii) Z(y) D B(0,1) for any y outside the compact set Kq defined as in 
(iii) S(yi,y 2 ) > 0 for any pair y 1 , y 2 outside K 0 . 

Proof: If q G R AI satisfies 

(37) Ho(y, q) = Co for some y in R M \ C, 

where C is defined as in (f35l) . then 

c 0 = Ho{Ui q) = max{—50(2/) °) ■ d ~ 4 (y,a)} < Q 0 \q\ - min £ 0 {y,a) 

a£A a£A 

and by the very definition of C 

c 0 + min a£A £ 0 {y,a) Q 0 

M -— q„ — > o~r 1 ' 


( 38 ) 
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Since 0 in the interior of Z(y) by (1351) . we derive a stronger version of item (ii), with C 
in place of Kq, which in turn implies 

for any y £ W M \C, v £ R M with r/0 


|u| for any y £ M. m \C, v £ M m with v ^ 0. 

and consider two points y± £ K, y 2 0 C and any curve 
(, defined in [0,1], linking them. We distinguish two cases according on whether the 
intersection of ( with C is nonempty or empty. In the first instance we set 

(40) t\ = min{f £ [0,1] | ((t) £ C} 

(41) t 2 = nrax{t £ [0,1] | £(i) £ C}. 

We denote by R an upper bound of |5| in C x C and exploit (f39l) to get 

(42) f cr(C,C)dt = [ cr(C,C)dt+ [ cr(C,C)dt+ [ a((,()dt 

JO Jo Jt\ Jt 2 

> \yi - ({h)\ + s(C(h),C(h)) + 1 1/2 - C(*2)| 

> — R + d(yi, C) + d(y 2 , C). 

If instead the curve C entirely lies outside C, we have by (f3Ul) 

( 43 ) [ cr(C,C)dt>\yi-y 2 \. 

Jo 

In both cases we get item (i) sending y 2 to infinity and taking into account that y± has 
been arbitrarily chosen in K. 

We finally see, looking at (1451) . (1431) . and slightly adapting the above argument that /<o, 
defined as in (l36|) . satisfies item (iii). □ 


H s Z(v) 

and consequently 

(39) cr(y,v) >v ■ = 

Next, we fix a compact set K 


Remark 3.5. Given a compact set I\ C the same argument of Proposition 13.41 allows 
also proving 

(44) lim inf S(y,y 0 ) = +oo 

|j/|—>+oo yo&K 


Corollary 3.6. For any bounded open set B there exists R > 0 such that ifyi, y 2 belong 
to B then all 1-optimal curves for S(y\,y 2 ) are contained in B(0,R). 
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Proof: We can assume without loosing generality that B D Kq, where Kq is the set 
defined in (l36j) . We set 

P = sup |5|. 

BxB 

By Proposition 13.41 (i) there is R such that 


inf S(yo, y) > 2 P + 2 for y with \y\ > R. 

yo&B 


We claim that such an R satisfies the claim. In fact, assume by contradiction that there 
are yi, y 2 in B and an 1-optimal curve £, defined in [0,1], for S(yi,y 2 ) not contained in 
B(0,R). Let t\ be a time in (0,1) with C(^i) & B(0,R) and set 


t -2 = min{f € (H, 1) | C(*) £ K o C B} 
then, taking into account Proposition 13.41 

S{yi,y 2 ) > [ 

Jo 


= [ o"(C,C)d t+ [ cr(C,C)dt+ [ cr(C,C)di-l 

J 0 J t\ Jt2 

> S(y u C(h)) + S(C(h),C(h)) + S(C(t 2 ),y 2 ) - 1 

> 2P + 2-P- 1 = P + 1, 


which is in contrast with the very definition of P. 


□ 


3.2. Existence of special subsolutions and solutions. Here we show the existence of 
bounded critical subsolutions, and of coercive critical solutions. 

Proposition 3.7. There exists a bounded Lipschitz-continuous critical subsolution u, van¬ 
ishing and strict outside the compact set Kq defined as in (1361) . 

Proof: By Proposition 13.41 item (iii) 

(45) S(yi,y 2 ) > 0 for any y u y 2 in R M \ K 0 , 

and consequently the null function is an admissible trace for subsolutions to Hq = co on 
R M \ Kq in the sense of Proposition IA.3I (iii), so that owing to Proposition IA.3I (iii) 

u(y) := inf {S{z,y) \ z G R M \ K 0 } 

is a subsolution to H o = Co in vanishing on R M \ Kq, in addition 

H 0 (y, Du) = H 0 (y , 0) < c 0 - Qo for y € R M \ K 0 C R M \C 
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by the very definition of C in (I35p . Since u is locally Lipschitz-continuous by Lemma 1,3.1 1 
and vanishes outside a compact set, it is actually globally Lipschitz-continuous in W M . 
This fully shows the assertion. 

□ 


We denote by Ao the Aubry set of Hq, see Proposition IA.4I for the definition. We have: 

Lemma 3.8. The Aubry set Ao is nonempty and contained in Kq, where Ko is defined 
as in (j36jl . 


Proof: We know from Proposition 13.71 that there is a critical subsolution which is strict 
outside Ko, so that by Proposition IA.4I (iii) Ao C Ko- The point is then to show that the 
Aubry set is nonempty. 

We argue by contradiction using a covering argument. If Ao = 0, then we can associate 
by Proposition IA.4I (iii) to any point y £ Kq an open neighborhood B y , a value d y < co, 
and a critical subsolution w y with 

Ho(-, Dw y ) < d y < co in B y . 

We extract a finite subcovering {B\, ■ ■ ■ , B m } corresponding to points y\, ■ ■ ■ . y rn of Ko, 
and set 


Then 


Wj = w yj 

dj = d yj for j = 1, - ■ ■ ,m. 
{Bo, B\, , B m }, 


where Bo = M. m \Ko, is an hnite open cover of . We denote by u the critical subsolution 
constructed in Proposition 13.71 and set do = co — Q o, so that 


H 0 (y, Du(y )) < d 0 < c 0 for any y £ B 0 . 


We define 


m 


w = Ao u + E XjWj, 

i=1 

where Aq, Ai, • • • , A m are positive coefficients summing to 1. We have by convexity of Hq 


H 0 (y,Dw{y)) < A 0 H 0 {y, Du{y)) + ^ XjH 0 {y, Dwfiy)), 

3 =1 


for a.e. y £ M. m , and we derive 


Ho{y, Dw(y)) < ^ A* c 0 + X 3 d 3 = (1 - Xfi c 0 + X 3 d 3 = c 0 + X 3 (d 3 - c 0 ) 
i¥=j 
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for a.e. y £ Bj, j = 0, • • • ,m. We set d = rnaxj Xj ( dj — co) < 0 and conclude 

H 0 (y, Dw(y)) < c 0 + d < c 0 for a.e. y £ M A/ , 

which is impossible by the very definition of Co- This gives by contradiction 0 Ao C Kq, 
as desired. 

□ 


From the previous lemma and Proposition 13.41 item (i) we get: 

Proposition 3.9. All the functions y >-)• S(yo,y), for y$ £ Ao, are coercive critical 
solutions. 

The previous line of reasoning can be somehow reversed. We proceed showing that the 
existence of coercive solutions, plus the coercivity of intrinsic distance, characterizes the 
critical equation and also directly implies that the Aubry set is nonempty, as made precise 
by the following result: 

Proposition 3.10. Assume that the equation 

H 0 (y,Du ) = b 

admits a coercive solution in and limit relation (I44H holds true with Sb in place of S, 
then b = co and the corresponding Aubry set is nonempty. 

Proof: The argument is by contradiction. Let w be a coercive solution of the equation 
in object. If b ^ co or Ao = 0 then by Corollary IA.5I Proposition IA.6I there is, for any 
R > 0, an unique solution of the Dirichlet problem 

f Ho(y,Du)= b mB(0,R) 

| u = w on dB( 0, R) 

which therefore must coincide with w, and 

(46) w;(0) = w(z) + Sb(z, 0) for any R > 0, some z € dB( 0, R). 

Since we have assumed (HU), with Sb in place of S , we have 

lim Sb(z, 0) = +oo 

\z\— H-oo 

and by assumption w is coercive. This shows that (1461) is impossible, and concludes the 
proof. □ 

We derive: 

Proposition 3.11. The effective Hamiltonian H : W N x M. N —>• R is continuous in both 
components and convex in p. 
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Proof: It is easy to see using the continuity of H and the argument in the proof of 
Proposition 13.31 that H is locally bounded. We consider a sequence (x n ,p n ) converging 
to some (x,p), and assume that H(x n ,Pn ) admits limit. We consider a sequence v n of 
solutions to 

H(x n , y,p n , Du) = H(x n ,p n ) 

of the form as in Proposition 13.91 By exploiting the continuity of H we see that the 
v n are locally equiLipschitz-continuous, locally equibounded and equicoercive. They are 
consequently locally uniformly convergent, up to a subsequence, by Ascoli Theorem, with 
limit function, say w, locally Lipschitz- continuous and coercive. In addition, by basic 
stability properties of viscosity solutions theory, w satisfies 

H(x,y,p,Dw) = lim H(x n ,p n ), 

n 


which implies by Proposition 13.101 that lim n H(x n ,p n ) = H(x,p). This shows the claimed 
continuity of H. 

We see by the very definition of H that 

H(x,y,\pt + (1 - \)p 2 ,Xqi + (1 - A) q 2 ) < XH(x,y,pi,q 1 ) + (1 - X) H(x,y,p 2 ,q 2 )- 

We derive from this that if ui, i = 1,2, satisfy H(x,y,pi, Dui) < H(x,pi ) in the viscosity 
sense, then 

H(x,y,Xpi + (1 - X)p 2 ,XDu\ + (1 - A ) Du 2 ) < XH(x,pi) + (1 - A )H(x,p 2 ), 

which in turn implies 

H(x,Xpi + (1 - A )p 2 ) < XH(x,pi) + (1 - A )H(x,p 2 ) 

as desired. 

□ 


3.3. Construction of a supersolution. We sill keep (xq,pq) fixed. Starting from Propo¬ 
sition Ea we construct a supersolution of the cell problem which will play the role of 
corrector in Theorem 14.31 We denote by Kq the set defined in ([36]) . We fix y$ € Aq] by 
the coercivity of S(yo, •), see Proposition 13.91 there is a constant d such that 

(47) d + S(yo,y) > 0 for any y £ R M . 

We select a constant Rq satisfying 

(48) B(0,Ro-3) DK 0 

(49) Rq — 3 satisfies Corollary 13.61 for a neighborhood of yo. 


We aim at proving: 
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Theorem 3.12. Let U : R AI —> R be a function bounded from above in B{ 0, Rq) with 

(50) 17 <0 in B(0,R 0 - 1), 

then there exists for any A > 0, a locally Lipschitz-continuous supersolution w\ of H 0 = cq 
in R AI with 

(51) U < A w\ inB(0,Ro ) 

(52) w\ = d + S(yo,-) in a neighborhood of yo. 

To construct the supersolutions w\ some preliminary steps are needed. 

We define 

Mq = max < sup — U, 1 > . 

[b(o,r 0 ) A J 

We denote by h\ : [0, +oo) —>• [0, +oo) a nondecreasing continuous function with 

(53) h x = 1 in [0, R 0 - 3] 

(54) h\ = Mq in [i? 0 - 2 ,+oo). 

We introduce the length functional 

/ hx(\f\)a(^i)ds 
Jo 

for any curve £ defined in [0,1], and denote by S h the distance obtained by minimization 
of it among curves linking two given points, we drop dependence on A to ease notations. 

Lemma 3.13. The function S h (yo,-) is a locally Lipschitz-continuous supersolution to 
H 0 = co in and coincides with S(yo, •) in a neighborhood ofyo. 

Proof: The function h\, defined in (|53j) . (1541) . satisfies h\ > 1 and if h\(\y\) > 1 then by 

JMD 

V £ B(0,R 0 -3) D K 0 

so that by Proposition 13.41 (ii) Ho(y, 0) < Co- We are thus in position to apply Proposition 
IA.71 which directly gives the asserted supersolution property outside yo, as well as the 
Lipschitz continuity. We also know by (l49l) and h\ = 1 in B{ 0, Ro — 3) that 

S h (yo, ■) = S(yo, •) in a neighborhood of y 0 , 

and S h (yo, •) is solution to Hq = co on the whole space, by Proposition 13.91 This concludes 
the proof. □ 

By the very definition of S h , we have: 

(55) S h > S in R m x R m . 
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We define 

(56) w\ = d+S h (y or ) 

where d, yo are as in (ITT]) . 

Lemma 3.14. The following inequalities hold true: 

w\ > 0 in 

w\ > Mo in \ B(0, Ro — 1). 

Proof: From (15511 and the definition of w\ we derive 

w\>d + S(y 0 , •) 

and this in turn yields w\ > 0 in because of (1471) . 

We fix y B(0,Ro — 1), and consider any curve C defined in [0,1] linking yo to y. We 
set 

t\ = max{f £ [0,1] | C(t) £ B( 0, Rq — 2)}, 

notice that 

\C(h) — y\ > 1. 

Owing to the above inequality, w\ > 0, Proposition 13.41 item (ii), the definition of h\. we 
have 

d+ f h A (|C|)cr(C,C)dt = d+ [ h x {\(\)a((,()dt+ f h x {\(\) dt 

Jo Jo Jti 

> w\(C(h))+ [ ^a(ICI) |C| dt 

Jtx 

> + Mo \y - C(ti)| > Mq. 

Taking into account the definition of w x and the fact that the curve ( joining yo t° y 0 
-B(0, Ro — 1) is arbitrary, we deduce from the above computation the desired inequality. □ 


Proof: (of Theorem I3TT21) In view of Lemma Hi. 131 it is just left to show (1511) . It indeed 

holds true in B{ 0, Ro — 1) because of (l50|) and w\ >0. If y £ B( 0, Rq) \ B( 0, Rq — 1), then 
by Lemma 13.141 we have 


w\(y) > M 0 > _sup 
B(0,Ro) 


u > 




□ 
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4. Asymptotic analysis 

We summarize the relevant output of the previous section in the following 

Theorem 4.1. We consider (xo,Po) € R^ x R N , a constant Ro satisfying ([38]) . (1491) . a 
function U bounded from above in B( 0, Ro ) and less than or equal to zero in _B(0, R 0 — 1), 
any positive constant A. Then the equation 

H(x 0 ,y,p 0 ,Du) = H(x 0 ,Po) inR AI 

admits a bounded Lipschitz-continuous subsolution and a locally Lipschitz-continuous su¬ 
persolution, say w\, satisfying El 


We recall the notations V = limsup^W, V = liminfjtW, where the V s are the value 
functions of problems ([15]) / (fl6l) . We consider a point (xo,to) € R N x (0,+oo), and set 

(57) K$ = B(x o, (5) x (to — S, to + d) for 5 < to- 

We further consider a constant Rq > 0 satisfying (l48|) . (l49l) . The next lemma, based on 
Theorem 13. 121 will be of crucial importance. The entities yo £ an d d appearing in the 
statement are defined as in (1471) : 


Lemma 4.2. Let ip be a strict supertangent to V at (xo,to) such that (xo,to) is the 
unique maximizer of V — ip in K$ 0 , for some <5o < to- Then, given any infinitesimal 
sequence £j, and 6 < <5o? we find a constant ps and a family w J of supersolutions to 
H(xq, y, Dip(xo, to), Du) = H(xq 1 Dip(xo, to)) in R A/ satisfying for j suitably large 

(58) £j > V £j — ip + ps in d(K$ x B( 0, Ro)) 

(59) w J = d + S(yo,-) in a neighborhood A$ of yo, 

where S is the intrinsic critical distance, see Subsection \3.1l related to (xq, Dtp(xo, to))- 


Proof: By supertangency properties of ip at (xo,to)> we find, for any 5 < do, a ps > 0 
with 

(60) max (V-ip) <-3 p s . 

We fix a d and define 

Tje, \ = f m & X( x ,t)edK 6 {V" £ (x, y, t) - ip(x, t) + p 6 } for y € B( 0, R 0 - 1/2) 

\ max (lit ) e jf s {V £ (x,y,t) - ip(x,t) + p s } for y G R M \ B(0, R 0 - 1/2). 

Notice that the U e are continuous for any e and locally equibounded, since the V £ are 
locally equibounded in force of Proposition 12.61 To ease notations we set 


W = U e T 
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Claim : There is jo = jo(Ro) such that 

U j < -ps in B( 0, R 0 - 1), for j > j 0 . 

Were the claim false, there should be a subsequence yj contained in B{ 0, Ro — 1) with 

U 3 {yj) > - ps■ 

The yj converge, up to further extracting a subsequence, to some y, and, being £j infini¬ 
tesimal, we get 

(61) (limsup # 17 £ )(y) > -p s . 

Moreover, there exists an infinitesimal sequence £,; and elements z % converging to y with 

lim U £i (zi) = (limsup^C/ £ )(y), 

i 

at least for i large Zi £ B(0, Rq — 1/2), and by the very definition of U £ in B(0, Rq — 1/2), 
we get 

U £i (zi) = V £i (xi, Zi, ti) — if{xi,ti) + ps for some {x^tf) € dK s , 
up to extracting a subsequence, ( Xi,ti ) converges to some (x,t) £ dKs so that by (1601) 

(limsup # t/ £ )(y) = limU £i (zi) = lim [V £i (xi, Zi,ti) - if (xi,ti) + p s \ 

< V(x,t) -ip(x,t) +p s < -2 ps- 

which is in contradiction with (1611) . This ends the proof of the claim. 

We are then in the position to apply Theorem 13.121 to any U °, and get a supersolution 
w 3 to H{x o, •, Dip(xo, to), ■) = H(xo, Dip(xo,to)), which satisfies, for j > jo, the condition 
(f59l) and 

£ jW j >U j inB(0,R 0 ). 

Owing to the very definition of U 3 , we derive from the latter inequality that 

£j w 3 (y) > V £j {x, y, t) - ip(x, t) + ps 

holds in 

dKs x B(0,Ro) UK 5 x dB(0, R 0 ) = d(K 5 x B(0,R 0 )). 

This proves (1581) and conclude the proof. 

□ 

We proceed establishing the asymptotic result for upper weak semilimit of the V £ . The 
first part of the proof is a version, adapted to our setting, of perturbed test function 
method. We are going to use as correctors, depending on e, the special supersolutions to 
cell equations constructed in Subsection 13.31 in the frame of Lemma 14.21 The argument of 
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the second half about behavior of limit function at t = 0 makes a direct use of the material 
of Subsections El El 


Theorem 4.3. The function V = limsup^W is a subsolution to (HJ) satisfying 


(62) 


limsup V(x,t) < uo(xq) 

(X,t)->(X Q.O) 

t> o 


for any xq G M. n . 


Proof: Let (xo,to) be a point in M ,v x (0,+oo), and if a strict supertangent to V at 
(xo,to) such that (xo,to) is the unique maximizer of V — if in K$ 0 , for some > 0 (see 
(1571) for the definition of Kg). 

By Proposition 12.71 we can find an infinitesimal sequence £j and ( Xj,yj,tj ) converging 
to (xo,yo,to), where yo is as in (1771) . with 

(63) lim V £j (xj,yj,tj) = V(x 0 ,t 0 ) = if(x 0 ,t 0 ). 

3 

We assume by contradiction 

(64) ift(xo,t 0 ) + H(x 0 ,Dif(x 0 ,to)) >2y 

for some positive rj. We apply Lemma El about coercivity of H , to the bounded set 

C := B(x 0 ,6 0 ) X B(0, R 0 ) x Dif(K So ), 

where Rq satisfies (USD, (@D, and exploit that H is locally bounded to find P > 0 with 

(65) H(x,y,p,q) > H(x,p) for (x, y,p) € C, q with |g| > P. 

Applying the estimates (|28|) to B(xq,5o) x B(0,Rq) and (1291) . we find 

(66) \H(x 0 ,y,Dif(x 0 ,t 0 ),q) - H(x,y,p,q)\ < 

Lo (|® - x 0 \)(\Dif(x 0 , t 0 )| + |g|) + 

u(\x -x 0 \) + Q \Dif(x 0 ,t 0 ) - p | 

for any (x,y) € B(xq,5q) x B(0, Ro) and (p. q) € l w x M m , where u is an uniform 
continuity modulus of £ in B{x o, 5q) x B( 0, Ro) x A, Lq is as in (H2) and Q is an upper 
bound of |/| in B(xq,6o ) x B(0,Ro) x A. 

Exploiting the continuity of Dif , iff, H, we can determine, 5o > 5 > 0 such that using 
(USD, dMD with q G B(0, P) and p of the form Dif(x,t ), we get 


(67) 

( 68 ) 
(69) 


\H(x 0 ,y,Dif(x 0 ,t 0 ),q) - H(x,y,Dif(x,t),q)\ < r\ 
\Dif(x,t) - Dif(x 0 ,t 0 )\ < rj 

ift(x,t) + H(x,Dif(x,t)) > 0 
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for (y,q) € B(0,Ro ) x B(0,P), (x,t) G K$. By applying Lemma 14.21 to such a 5, we find 
a constant p$ > 0 and a family w 3 of supersolutions to 

H(x 0 ,y,Po,D'ip(x 0 l to) 1 Du) = H(x 0 , D'tp(x 0 ,t 0 )) in R AI 

with 

(70) Ej w 3 > V E > - ip + p s in d(K s xB(0,R 0 )) 

(71) w 3 = d + So(yo, •) in a neighborhood Aq of yo, 

for j large enough, see (ED for the definition of d. We claim that the corrected test 
function ip + w 3 satisfies 


ipt{x,t) + H(x,y,D'ip(x,t), Dw 3 ) > 0 

in K§ x -B(0, Ro) in the viscosity sense. In fact, let <p be a subtangent to ip + w 3 at some 
point (, x,y,t ) € K$ x B(0,Rq), then 


<Pt(x,y,t) = ip t {x,t) 
D x <p(x, y, t) = Dip(x,t) 

and so, to prove the claim, we have to show the inequality 


ipt(x 7 t) + H(x,y,Di’(x,t),D y cp(x,y,t)) > 0. 


We have that 


Z l-A (p(x, z, t ) 


is supertangent to w 3 at y, which implies by the supersolution property of w 3 


H(x 0 ,y, Dip(x 0 ,t 0 ), D y (p(x , y, t)) > H(x 0 , Dip(x 0 , to)) 

If \D y <p(x,y,t)\ < P then by (1M1) . (1671) and (|68l) 

ipt{x,t) + H(x,y,Dip(x,t),D y (p(x,y,t)) > 
ipt(xo,t 0 ) - y + H(x 0 ,y,Dil’(xo,to),D y (p(x,y,t)) ~ V > 
ipt(xo,t o) + H(xo,D'ip(x 0 ,t 0 )) -2y>0. 

If instead \D y cp(x,y,t)\ > P then by (1651) . (1691) 

ipt(x,t) + H(x,y,Dip(x,t),D y (p(x,y,t)) > 
ipt{x, t ) + H(x, Dip(x, t)) > 0. 

The claim is then proved. For j large enough, the functions V £j , ip + £j w 3 — ps are then 
subsolutions and supersolutions, respectively, to 

=Q 

£j J 


u t + H x,y,D x u, 
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in Kg x B(0,Ro), then taking into account the boundary inequality (1701) . we can apply 
the comparison principle of Proposition 12.101 to the above equation to deduce 

(72) V £j < ip + £j w 3 — ps in Kg x B( 0, Rq). 

On the other side, let (xy, yj. tj) be the sequence converging to (xo,yo,to) introduced in 
(1631) . then for j large ( Xj,yj,tj) £ Kg x B(0,Rq), and w 3 (yj) = d + S(yo,yj) by ([71]) . so 
that 

limey w 3 (yj) = 0. 
j 

We therefore get 

lim [V ej (xj,yj,tj) -ip(xj,tj) - £jW 3 {yj )] = V(x 0 ,t 0 ) -i/>(x 0 ,t 0 ) = 0 
which contradicts m- 

We proceed proving ([62]) . We consider (x n ,t n ) converging to (xo,0) such that V(x n ,t n ) 
admits limit. Our task is then to show 

lim V(x n ,t n ) < u 0 (x 0 ). 

n 


We find for any n an infinitesimal sequence e™ and (x”,converging to (x n ,0,t n ) 
with 

lim V (x"y y™, tf) = V(x n , t n ), 

0 £ is clearly an arbitrary choice, in view of Proposition 12.71 By applying a diagonal 
argument we find e n converging to 0 and (z n ,y n ,s n ) converging to (xq,0, 0) with 


(73) 

lim V en (z n ,y n ,s n ) 

= lim V (x n , t n 

n 

n 

(74) 

lim — = +oo. 


Given 6 > 0, we denote by y a (5-minimizer of j/4 uq(xq, y) in , see assumption (H5). 
By applying Proposition 12.31 Lemma 12.41 and taking into account ( 1741 ) . we find for any n 
sufficiently large a trajectory (£ n , r/ n ) of < \CP £ \) , with e = e n , corresponding to controls a n 
and starting at ( z n ,y n ), such that 


(75) (£nj Vn ) is contained in a compact subset independent of n as t £ [0,s n /e n ] 

(76) | r]n(s n /£n) ~y\ = 0(e n ) 


By using formulation (1151) of minimization problem, we discover 


V (z n , y n i s n ) £ r 


l 


^n(^)) dt + ^0(£71(^72/ ^n)i Vn{^n/ £71)) ? 
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where the integrand is estimated from above by a constant, say Q , independent of n, 
because of (ESI), therefore 

V {%n , Uni Sn) ^ Q “1“ (£n (®n/£ri), (sn/^n)) 

Owing to dH), (1751) . ESP , and the fact that is infinitesimal, we then get 

lim V(x n , t n ) = lim V £n (z n ,y n ,s n ) < u 0 (x 0 ,y ) < U 0 (x 0 ) + 5- 

n n 

This concludes the proof because 5 is arbitrary. □ 


The second main result concerns lower weak semilimit. Here we essentially exploit the 
existence of bounded Lipschitz-continuous subsolutions to cell equations established in 
Proposition 13.71 plus the coercivity of the V s proved in Proposition 12.81 The part of the 
proof about behavior of limit function at t = 0 is direct and not based on a PDE approach. 
We recall that (uq)# stands for the lower semicontinuous envelope of uo, see Subsection 
12.11 for definition. 


Theorem 4.4. 

(77) 


The function V = liminf^W is a supersolution to (IHJ[) satisfying 
lirninf V(x, t) > (uo)#(xq) for any x o € M w . 

(x,t)—► Oo,0) 
t>0 


Proof: Let (xo, to) be a point in x (0, +oo), and ip a strict subtangent to V_ at (xo, to) 
such that (xo,to) is the unique minimizer of V — p in Kg 0 , for some 5q > 0 (see (1571) for 
the dehnition of K$). We assume by contradiction 

(78) <p t (x o,to) + H(x o, Dip(x 0 ,t 0 )) < 0. 

Given e > 0, we can find by Proposition 12.81 about coercivity of value functions, R e > 1 
satisfying 

(79) V £ (x,y,t) > supp + 1 for (x, t) € K$ 0 , y € K A/ \ B(0, R £ ). 

K s 0 

We can also find, exploiting Proposition 13.71 a Lipschitz-continuous subsolution u to the 
cell problem 

(80) H(x 0 ,y,Dp(x 0 ,t 0 ),Du) = H(x 0 ,Dp(x 0 ,t 0 )) in R M 
with 

(81) u(y) < 0 for any y € K M . 

By using estimate (1281) on H, Lipschitz continuity of u , continuity of H, Dp, p t and ESP, 
(l80l) we can determine 0 < 6 < 5o such that u + p is subsolution to 

in K s x R m . 


w t + H (x, y, Dp(x, t ), Dw) = 0 
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Owing to strict subtangency property of ip, there is 1 > p > 0 with 

V_ — ip > 2 p in dKs, 

and, taking into account that V is the lower semilimit of the V £ , we derive 

V £ ~ip>p in dK s x B{0,R £ ) 
for e sufficiently small, which in turn implies by (1811) 

(82) V £ — tp — u > p in dKs x B{ 0, R e ). 

Owing to (1791) , dSTT) , we also have 

(83) V £ — ip — u > p in I<s x dB{ 0, R e ). 

Since V £ , (p + eu + p are supersolution and subsolution, respectively, to 

w t + H fx, y, D x w , = 0 

in K's x B(0, Rq), the boundary conditions ([82]) . (|83l) plus the comparison principle in 
Proposition 12.101 implies 

(84) V £ > ip + eu + p in Kg x B{ 0, R e ), for e small. 

On the other side, there is by Proposition 12.71 an infinitesimal sequence £j and a sequence 
(. Xj,yj,tj) converging to (xo,0,to) with 

lim V £j {xj,yj,tj) = V(x 0 , t 0 ) 

3 

and consequently 

lim [V e *(xj,yj,tj) - <p(xj,tj) - £ju(yj)] = V(x 0 ,t 0 ) - <p(x 0 ,t 0 ) = 0. 

3 

Taking into account that R e > 1 for any e, and ( Xj,yj,tj ) are in Ks X B(0, 1) for j large, 
the last limit relation contradicts (1841) . 

We proceed proving ([77]) . We consider (x n ,t n ) converging to (xo,0) such that V_(x n ,t n ) 
admits limit, with the aim of showing 

lim V(x n ,t n ) > (u 0 )#(x 0 ). 

Arguing as in the final part of Theorem 14.31 we find an infinitesimal sequence e n and 
{zn,yn,s n ) converging to (xo,y, 0), for some y £ R A/ , with 

lim V £ "(z n ,y n ,s n ) = lim V(x n ,t n ). 

n n 

We fix 5 > 0. Arguing as in second half of Proposition 12.61 see estimate (1181) . we determine 
a constant Pq independent of n and trajectories (£ n , r/ n ) of the controlled dynamics starting 
at ( z n ,y n ) with 

V fen i Vm Sn) — B{) S n + Ufl {^ n {s n /£r i), Pn (®n/^n)) ^ Sn T Uq (£ n (s n /£n)) 
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Since by the boundedness assumption on / 

|?n(Sn/£n) %n | 5s Qo 

we get at the limit 

lim V(x n ,t n ) = lim V Sn (z n , y n , s n ) > liminf u 0 (€ n (s n /E n )) -5> (u 0 )#(x 0 ) - 6, 

n n n 

which gives the assertion since 5 is arbitrary. 

□ 


Appendix A. Facts from weak KAM theory 
Here we consider an Hamiltonian F(y, q ) defined in l w xM^ and the family of equations 

(85) F(y, Du) = b in M m , for b € M 

We assume F to satisfy 

F is continuous in both variables; 

F is convex in g; 

limigi^+oo min y eK F(y,q) = +oo for any compact subset K of R M . 

Our aim is to recall some basic facts of weak KAM theory, which will be exposed here through the 
so-called metric method for equation (1551) . see Ha, HE m, M- We define the critical value of 
F as 

(86) c = inf{6 | (1551) has subsolutions in R M }. 

Being the ambient space non compact c can also be infinite. We assume in what follows 
The critical value of F is finite. 

We call supercritical a value b with b > c. By stability properties of viscosity (sub)solutions, 
subsolutions for the critical equation do exist. We derive from coercivity of F: 

Lemma A.l. Let b a supercritical value. The subsolutions to F = b are locally equiLipschitz- 
continuous. 

We adopt the so-called metric method which is based on the definition of an intrinsic distance 
starting from the sublevels of the Hamiltonian for any supercritical value. For any b > c we set 

Zb(y) = {q I F(y,q) < b} y G R M . 

Owing to continuity, convexity and coercivity of F, we have: 

Lemma A.2. For any b > c, the multifunction y <—> Zb(y) takes convex compact values, it is 
in addition Hausdorff-continuous at any point yo where intZh(j/o) 7^ 0 and upper semicontinuous 
elsewhere. 
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We further set 

a b (y, v ) = max{g • v \ q G Z b (y)} for any y, v in M m , 

namely the support function of Z b (y) at q , and define for any curve £ defined in [0,1] the associated 
intrinsic length via 

[ i) ds. 

Jo 

Notice that the above integral is invariant for orientation-preserving change of parameter, being 
the support function positively homogeneous and subadditive, as a length functional should be. 
Also notice that because of this invariance the choice of the interval [0,1] is not restrictive. For 
any pair yi , y 2 we define the intrinsic distance as 

Sb(yi,V 2 ) = inf o&(£,£)ds|£ with £(0) = y 1} £(1) = 2/2 j • 

The intrinsic distance is finite for any supercritical value b. 

Proposition A.3. Given b > c, we have 

(i) a function u is a subsolution to F = b if and only if 

u(y 2 ) - u(yi) < S b (yi,y 2 ) for any yi, y 2 ; 

(ii) for any fixed yo, the function y >—> S b (yo , y) is subsolution to F = b in R M and solution in 

K M \ {yo}; 

(iii) Let C, w be a closed set of R A/ and a function defined in C satisfying 
w{y 2 ) - w(y\) < S b (yi,y 2 ) for any yi, y 2 in C 
then the function 

y inf{ 1 ^( 2 :) + S b (z, y) \ z S C} 

is subsolution to F = b in solution in \ C and equal to w in C. 

In contrast to what happens when the ambient space is compact, namely F = b admits solutions 
in the whole space if and only if b = c, in the noncompact case instead there are solutions for any 
supercritical equation. It is in fact enough that the intrinsic length is finite, as always is the case 
for supercritical values, to get a solution. 

The construction of such a solution is in fact quite simple. One considers a sequence y n with 
\y n \ diverging and the functions 

= S b {ym *) S b (ym 0 )- 

By Lemma |A.II and Proposition IA.31 the u n are solutions except at y n , are locally equiLipschitz- 
continuous, and also equibounded, since they vanish at 0. They therefore converge, up to a 
subsequence, by Ascoli Theorem. Having swept away the bad (in the sense of Proposition lA.31 (ii)) 
points y n to infinity, but kept the solution property by stability properties of viscosity solutions 
under uniform convergence, we see that the limit function is indeed the sought solution of F = b. 

We say that a function u is a strict subsolution to F = b in some open set B if 
F(x, Du) < b — 6 for some 6 > 0, in the viscosity sense in B. 
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The points satisfying the equivalent properties stated in the following proposition, make up the 
so-called Aubry set, denoted by A. 

Proposition A.4. Given yg G S. AI , the following three properties are equivalent: 

(i) there exists a sequence of cycles £„ based on yo and defined in [0,1] with 

inf / cr c (£ n ,£ n )ds = 0 and inf / |£„|ds>0; 

71 Jo n Jo 

(ii) y H > S c (yo,y) is solution to F = c in the whole o/R M ; 

(iii) if a function u is a strict critical subsolution in a neighborhood of y 0 , then u cannot be 
subsolution to F = c in R A/ . 

Notice that, in contrast with the compact case, even if the critical value is finite, the Aubry set 
can be empty for Hamiltonian defined in R M x R M . We derive from Proposition [X]4] (iii) adapting 
the same argument of Lemma 13.81 

Corollary A.5. Assume that the Aubry set is empty, then for any bounded open set B of R M , 
there is a critical subsolution which is strict in B. 

We record for later use: 

Proposition A.6. Let B, b be an open bounded set of R M , and a critical value, respectively. 
Assume that the equation F = b admits a strict subsolution in B, and denote by w a subsolution 
of F = b in R m . Then the Dirichlet problem 

f F(y, Du) = b in B 
u = w on dB 

admits an unique solution u given by the formula 

u(y) = inf{tu( 2 ) + S b (z,y) \ z G dB}. 

We now consider a supercritical value b and a function h : R M —»• R with 
(87) h > 1 in R M and h{y) > 1 =>■ F(y, 0) < b. 

We define for any curve £ in [0,1] the length functional 

[ M£) a b(^, i) ds 
Jo 

and denote by S'}) the corresponding distance obtained as the infimum of lengths of curves joining 
two given points of R M . We have 

Proposition A.7. Let b, h be a supercritical value for F and a function satisfying (18711 . respec¬ 
tively, then S^{zq, ■) is a locally Lipschitz-continuous supersolution to (l85l) in R M \ {zq}, for any 
z 0 GR m . 
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Proof: We fix zq- For any (y, v ) G K M x R M , h{y) ab{y, v) is the support function of the 6-sublevel 
of the Hamiltonian 


( 8 8 ) (M) 

and is the corresponding intrinsic distance. According to Proposition IA.31 (ii), w := S^(zq, •) 
is subsolution to (1851) in R. M , and supersolution in R AI \ {^o}, with F replaced by the Hamiltonian 
in (1551) . Since the Hamiltonian in (1551) keeps the coercivity property of F, this implies that w is 
locally Lipschitz-continuous in force of Lemma IA.1I 

Taking into account the supersolution information on w, we consider a subtangent if) to w at a 
point y. If h(y) = 1 then 

(89) F{y, Dip(y)) = F (y, > b- 

If instead h(y) > 1 then by (1571) and convex character of F 


and consequently 
(90) 





D^(y) \ 

Kv) ) 


< 


i 

Kv) 


F(y,Dip(y)) + 1 



TJ~T F(y, Dip(y)) > 6 

Kv) 




Formulas (1551) . (1501) provide the assertion. 


□ 
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